Hybrid interface for simultaneous biosensing and user input

ABSTRACT

Dynamically adjustable EDA measurement device may include: a dynamically formable base comprising a soft robotics material, wherein the dynamically formable base comprises a formable surface configured to be dynamically formed in response to input signals; and an EDA sensing layer affixed to the formable surface of the dynamically formable base, the EDA sensing layer comprising a plurality of electrodes arranged on a flexible substrate and configured to be connected to a power supply; wherein, in response to input signals, the formable surface of the dynamically formable base and the EDA sensing layer affixed thereto are reformed into a desired contour.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims the benefit of U.S.patent application Ser. No. 17/076,135 filed Oct. 21, 2020, which ishereby incorporated herein by reference in its entirety for allpurposes.

TECHNICAL FIELD

The present disclosure relates generally to biosensing, and inparticular, some implementations may relate to a conformable biosensorfor various applications.

DESCRIPTION OF RELATED ART

User-facing technology in passenger vehicles has evolved dramaticallyover recent years, and some vehicles have taken advantage of the latestadvancements available. Accordingly, contemporary user interfaces arebeing tasked to allow the user to control greater functionality thanever before as well as to access a greater amount of information.Although today's user interfaces in the cabin are far from the simpleswitchgear that was common in 20^(th) century vehicles, these interfacesare still limited to somewhat conventional applications of buttons,knobs and touchscreen interfaces.

In addition, vehicles are increasingly incorporating technology to senseand utilize bioinformatics from vehicle passengers. Bioinformaticsinformation is used in a number of places, including vehicle safetysystems to sense driver awareness and capacity. Some biosensing devicescapable of measuring Electrodermal Activity (EDA) have been used tomeasure emotional state of the driver, which can be used to recognizedriver stress levels. These methods typically require fixed electrodesadhered to the skin, such as those used with ECG devices. Accordingly,conventional biosensing devices for EDA measurements are not well suitedto the passenger cabin.

BRIEF SUMMARY OF THE DISCLOSURE

Various embodiments of the disclosed technology relate to each hybridsurface for user input that allows a combination of touch input foractuation and sensing of Electrodermal Activity (EDA). Embodiments maybe configured to include the capability to record EDA without requiringtraditional fixed electrodes glued to the skin. In various embodiments,data collection may be realized (e.g., continuously) when the skin ofthe user (e.g., the Palm of the user's hands) contacts the device'ssurface. Embodiments may enable easy and seamless data collectionwithout requiring electrodes affixed to the user's skin.

Embodiments may also utilize shape-changing materials, such asLiquid-Crystalline Elastomers (LCEs) to implement the touch inputsurfaces. Use of LCEs or soft robotics can allow configurable orconformable shapes to better suit desired applications. For example,hybrid surfaces can be conformed to accommodate the Palm of theoperators hands. As another example, the hybrid surfaces can beconfigured to be adjusted to provide a tactile queue or feedback to theuser.

In various embodiments, a dynamically formable electrodermal activity(EDA) sensor may include: a dynamically formable base comprising a softrobotics material, wherein the dynamically formable base comprises aformable surface configured to be dynamically formed in response toinput signals; and an EDA sensing layer affixed to the formable surfaceof the dynamically formable base, the EDA sensing layer comprising aplurality of electrodes arranged on a flexible substrate and configuredto be connected to a power supply; wherein, in response to inputsignals, the formable surface of the dynamically formable base and theEDA sensing layer affixed thereto are reformed into a desired contour.

Systems may further include an actuation layer comprising a plurality oftouch-sensitive actuation points, the actuation layer disposed betweenthe EDA sensing layer and the formable surface.

Embodiments may further include a plurality of pressure sensorsdistributed at determined locations beneath the EDA sensing layer tosense pressure of a user's body part at the determined locations, andmay further include a processor to provide the input signals to thedynamically formable base in response to the pressure measured at thedetermined locations to adjust the formable surface of the dynamicallyformable base to conform to the user's body part.

In embodiments, dynamically formable base may include a plurality ofseparately actuatable elements arranged in a matrix, such thatcontrolling the input signals to each of the separately actuatableelements determines a result in contour of the formal surface. Inembodiments, dynamically formable base may include a nonlinear softrobotics material.

Embodiments may further include a sensing module configured to evaluatea connection strength between each electrode of the EDA layer and theuser's skin at a given time and to identify electrodes from which EDAmeasurements are to be made based on the evaluation. The sensing modulemay be further configured to determine an EDA of the user based on EDAmeasurements from identified electrodes.

In embodiments, the EDA of the user is determined based on a combinationof measurements from the identified electrodes.

The dynamically formable base may be configured to be reformed toconform to at least a portion of a user's hand.

The dynamically formable base may be configured to be reformed toprovide a haptic response to a user of the EDA sensor.

In some embodiments, a hybrid electrodermal activity (EDA) sensor anduser input device may include: a flexible EDA layer comprising a firstflexible substrate and a plurality of electrodes disposed on the firstflexible substrate in a determined pattern; and a flexible actuationlayer comprising affixed to the flexible EDA layer, the flexibleactuation layer comprising a first pattern of electrical contactsdisposed on a second flexible substrate and a second pattern ofelectrical contacts disposed on a third flexible substrate wherein thesecond pattern overlaps the first pattern.

In embodiments, the first, second and third flexible substrates comprisetransparent substrates, and wherein the electrodes disposed on the firstflexible substrate and the electrical contacts first and second patternof electrical contacts disposed on the second and third flexiblesubstrates comprise transparent conductive materials.

The hybrid EDA sensor and user input device may further include aplurality of pressure sensors configured to detect an amount of pressureapplied by a user to the flexible EDA layer.

The hybrid EDA sensor and user input device may further include asensing module configured to evaluate a connection strength between eachelectrode of the flexible EDA layer and a user's skin at a given timeand to identify electrodes from which EDA measurements are to be madebased on the evaluation.

The hybrid EDA sensor and user input device of claim may be furtherconfigured to determine an EDA of the user based on EDA measurementsfrom identified electrodes.

The hybrid EDA sensor and user input device may be configured todetermine the EDA of the user based on a combination of measurementsfrom the identified electrodes.

In some embodiments a system for processing information from a pluralityof electrodermal activity (EDA) sensors to determine an EDA of a usermay include: a processor; a non-transitory memory coupled to theprocessor and configured to store instructions, the instructions, whichwhen executed cause the processor to perform the operations including:receiving information from a plurality of electrodes of an EDA sensor;determining which electrodes of the plurality of electrodes of the EDAsensor are providing valid EDA information; and combining EDAinformation from the determined plurality of electrodes that areproviding valid EDA information to arrive at an EDA measurement for theuser. Combining EDA information may include computing a weighted averageof EDA measurements from the determined plurality of electrodes.

In some embodiments a method of processing information from a pluralityof electrodermal activity (EDA) sensors to determine an EDA of a usermay include: receiving information from a plurality of electrodes of anEDA sensor; determining which electrodes of the plurality of electrodesof the EDA sensor are providing valid EDA information; and combining EDAinformation from the determined plurality of electrodes that areproviding valid EDA information to arrive at an EDA measurement for theuser. Combining EDA information may include computing a weighted averageof EDA measurements from the determined plurality of electrodes.

Other features and aspects of the disclosed technology will becomeapparent from the following detailed description, taken in conjunctionwith the accompanying drawings, which illustrate, by way of example, thefeatures in accordance with embodiments of the disclosed technology. Thesummary is not intended to limit the scope of any inventions describedherein, which are defined solely by the claims attached hereto.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure, in accordance with one or more variousembodiments, is described in detail with reference to the followingfigures. The figures are provided for purposes of illustration only andmerely depict typical or example embodiments.

FIG. 1 illustrates an example of a typical EDA measurement setup usingelectrodes affixed to the skin.

FIG. 2 illustrates an example surface that provides EDA sensing inaccordance with various embodiments.

FIG. 3 illustrates an example current sensing circuit that may be usedto sense current in each leg of a circuit in an EDA sensing surface inaccordance with various embodiments.

FIG. 4 illustrates an example actuation layer configured as a touchsensing mesh to sense a user's touch in accordance with variousembodiments.

FIG. 5 illustrates an example embodiment in which EDA sensing surfacesare located on a vehicle steering wheel.

FIG. 6 illustrates an example embodiment in which EDA sensing surfacesare located at multiple locations inside a vehicle cockpit.

FIG. 7 illustrates an example embodiment in which an EDA sensing surfaceis located on the vehicle center console adjacent a touchpad or scrollwheel.

FIG. 8 illustrates an example of a structure for dynamicallyconfigurable EDA surface in accordance with various embodiments.

FIG. 9 illustrates an example in which soft robotics-based matrix 414 isre-shaped to conform to the user's hand 420, and further illustratesthat the EDA layer 412 (and the actuation layer, if included) conform tothe reshaped soft robotics-based matrix 414.

FIG. 10 is an example computing component that may be used to implementvarious features of embodiments described in the present disclosure.

The figures are not exhaustive and do not limit the present disclosureto the precise form disclosed.

DETAILED DESCRIPTION

Embodiments of the technology disclosed herein can provide a conformablehybrid surface configured to sense Electrodermal Activity (EDA) of auser and to be physically conformable to a desired shape. For example,the surface can be configured to be conformable to the users palm orhand. Various embodiments may be configured such that the surface canalso act as a switch, touchpad or other actuator to provide a means forgathering user input as well as for sensing EDA. Embodiments may also beconfigured to allow the surface to be reshaped to provide tactilefeedback to the user. For example, the shape can be configured to raise,become textured, to undulate or to otherwise be physically reshaped toprovide information to the user tactilely.

Embodiments may be configured to include the capability to record EDAwithout requiring traditional fixed electrodes glued to the skin. Invarious embodiments, data collection may be realized (e.g., continuouslyor at determined times or intervals) when the skin of the user (e.g.,the palm or finger(s) of the user's hand) is in contact with the devicesurface. Shape-changing materials, such as Liquid-Crystalline Elastomers(LCEs) or other soft robotics may be used to implement the touch inputsurfaces. Such implementations can allow configurable or conformableshapes to better suit desired applications. Different types of LCE (orlike) structures may be combined in various embodiments to providedifferent types of haptic response, including surface deformations.Examples of materials other than LCEs may include other materials thatmay be implemented to generate changes in shape/volume/size, such as:pneumatic devices, liquid-pumping devices, shape-memory alloys, electricrubbers, and so on.

By varying the location and level of stimuli to one or more LCEstructures, various shapes can be dynamically created in the deformablesurface such that the user can differentiate through feeling differenticons. Soft components that may be used for soft robotics include, forexample, silicone elastomers, urethanes, hydrogels, hydraulic and otherfluids. Embodiments may also use shape memory alloys and shape-memorypolymers to provide desired deformations. Soft robotic components can beconfigured to have linear or nonlinear deformation characteristics toprovide flexibility in accomplishing specific formations.

Embodiments may implement separate soft robotics components combined ina pixel -like arrangement to allow dynamic formation and reformation ofparticular shapes by controlling the adjustment of each ‘pixel’ orrobotics element individually. Other embodiments may use soft roboticscomponents with nonlinear deformation characteristics to provide thedesired shapes.

EDA refers to variations of electrical properties of the skin as aresult of factors such as the secretion of sweat. EDA might also bereferred to as galvanic skin response, skin conductance, electrodermalresponse, among other terms. EDA measurements evaluate the electricalproperties of the skin to measure sweat secretion. Particularly, EDAmeasurement techniques apply a low voltage to the skin to measurechanges in skin conductance. Such techniques pass a current between twoelectrodes and measure and record the electrical resistance betweenthese two electrodes. EDA is said to be an indicator of a level ofarousal of the autonomic nervous system. Accordingly, EDA can be used toaid in determining whether a vehicle operator (or other individual) isundergoing increased levels of stress or experiencing other emotionssuch as, for example, fear and anger, and so on.

In some embodiments, EDA sensors may be layered on top of a shapechanging (e.g., LCE) base to provide an EDA sensing structure that isalso conformable or able to provide haptic feedback or other hapticresponse.

FIG. 1 illustrates an example of typical EDA measurements usingelectrodes affixed to the skin. Conventional solutions measure EDA bygluing a pair of electrodes to the skin at the Palm (e.g., at points 11,12) or the fingers (e.g., at points 14, 15 or at points 17, 18). Onereason electrodes are affixed to the skin such as by an adhesive is sothat they make good electrical contact with the skin. Electrodes thatare not firmly affixed to the skin may result in noise in themeasurements or failure to achieve measurements at all.

Embodiments may be configured to sense EDA without relying on electrodesaffixed to the skin. Surfaces can be provided with a plurality ofsensing locations that can make EDA measurements in response to the usercontacting any of a number of different locations on a surface. FIG. 2illustrates an example EDA surface that provides EDA sensing inaccordance with various embodiments. This example illustrates an EDAsensing surface 130 that includes a plurality sensors made up ofelectrode-contact pairs 233, 235 that can be used to measureconductivity of the skin.

Although this example illustrates five sensors in a single row,embodiments may include different quantities of sensors in differentpatterns, in a single row, in multiple rows, in a staggered arrangement,or placed without regard to rows or like alignment considerations. Thepower supply 132 applies a voltage potential across eachelectrode-contact pairs 233, 235, which are arranged in the circuit inparallel. Electrodes can be manufactured using conductive materials suchas, for example, copper, silver or silver chloride.

This example can be configured to measure changes in conductivity of theskin due to factors such as, for example, increases or decreases in theactivity of sweat glands. Factors such as levels of agitation,attention, emotions, and other like conditions can affect the secretionof sweat by the eccrine glands. Changes in the amount of sweat changedthe conductivity of the skin, which changes the resistance seen by eachleg of the circuit. Based on Ohm's law, as resistance decreases thelevel of current increases, assuming a constant voltage. Accordingly,embodiments may be configured to measure current as a mechanism formeasuring EDA.

Power supply 132 can be configured to supply a constant or time-varyingvoltage to the electrodes. Although not illustrated, the circuit mayalso include a small resistance (relative to the skin resistance)configured in series with the voltage supply in the electrodes. As notedabove, the system can be configured to measure skin conductance bymeasuring the current flow through the electrodes. A current sensingcircuit can be included for each leg of the circuit to measure thecurrent at each leg. An example current sensing circuit detects thecurrent and converts it to a measurable output voltage, which isgenerally proportional to the current through the path being measured.Any of a number of current sensing circuits can be used including, forexample, a current sensing resistor in which the voltage drop across aresistor of a known resistance value can be used to derive a currentaccording to Ohm's law, V=I*R. Other current sensing circuits can beused including, for example, operational amplifier circuits.

The EDA sensing surface 130 may be configured as a sheet or likestructure into or onto which the electrodes are placed. The electrodes(e.g., electrode-contact pairs 233, 235) and associated interconnectscan be printed or otherwise disposed on or partially encapsulated in arigid or flexible material. Any of a number of different techniques maybe used to provide conductive electrodes on top of the surface of thesubstrate such as, for example, screen printing, 3D printing, etching,deposition and other techniques. Because the interconnects (e.g. wires)don't require direct contact with the skin, they can be coated withinsulating material or otherwise embedded within the substrate (e.g.,below the outer surface) such that only the electrode-contact pairs 233,235 are exposed to sense the users EDA data.

FIG. 3 illustrates an example current sensing circuit that may be usedto sense current in each leg of the circuit in EDA sensing surface 130in accordance with various embodiments. This example circuit includes anoperational amplifier 238 configured as a difference amplifier with fourresistors R1, R2, R1*, R2*. In this example circuit, operationalamplifier 238 amplifies the voltage drop across the sensing resistor Rsby the gain R2/R1. This can be useful in applications where the sensedvoltage signal is small enough that it could benefit from amplification.The output voltage V_(OUT) is proportional to the current. The outputvoltage V_(OUT) is given by:

$V_{OUT} = {{\left( {V_{1} - V_{2}} \right) \cdot \left( \frac{R_{2}}{R_{1}} \right)} + {V_{REF}.}}$

Embodiments may be configured to combine EDA sensing with user inputinterfaces in vehicles and in other applications. In most conventionalapplications, input interfaces, such as those used for head units,infotainment systems, climate control systems, and others are limited toproviding a simple input option such as a button, switch or touchscreen.In some cases, haptic feedback may be provided to allow the user todetermine based on touch whether the action was performed or not. Forexample, actuations of a touchscreen interface may be accompanied by avibration or a tone to indicate that the input was accepted. UtilizingEDA sensing circuits, such as the example described with reference toFIG. 2 , in combination with touch inputs (e.g., touch screens,touchpads etc.) embodiments can provide data collection that can beaccomplished when the skin of the user's palm or fingers touches theinput surface, or touches an accompanying surface near the inputsurface. Accordingly, embodiments may be configured to enable seamlessdata collection.

Embodiments may be implemented to form a hybrid sensing circuit thatcombines EDA sensing with a user input interface. For exampleembodiments may combine an EDA sensing layer (e.g., as in the example ofFIG. 2 ) with a touch sensing layer (e.g., a touch sensing mesh as inthe example of FIG. 4 , below) to recognize user's touch. Accordingly,the electrode layer to sense EDA can be layered on top of an actuationlayer configured to sense user input.

FIG. 4 illustrates an example actuation layer configured as a touchsensing mesh to sense a user's touch in accordance with variousembodiments. In this example, actuation layer 140 includes a mesh ofconductive lines 244 or patterns disposed on a flexible substrate 243.More particularly, actuation layer 140 may include two patterns ofelectrodes, each arranged on their respective substrates in anoverlapping fashion. These can include a driving layer of electrodes anda sensing layer of electrodes separated by an insulator such that theelectrodes can be used to detect the occurrence and location of a user'stouch. In the example illustrated in FIG. 4 , the two patterns ofelectrodes 244 are arranged as vertical and horizontal lines that crossone another at regular intervals. The capacitance value can be measuredat each wire intersection, creating a capacitance matrix. A detectionmodule can be included to monitor changes in capacitance values in thismatrix to determine whether the user is touching the surface or not, andwhich part of the surface the user is touching. Additionally,embodiments may include a mesh of pressure sensors (not illustrated) tomeasure the amount of force with which the user's touch is being appliedto the mesh.

Flexible materials may be used to implement either or both the EDAsensing layer and the actuation layer. This can allow flexibility whenplacing an EDA sensor or hybrid interface at various locations withinthe automobile or other vehicle or application. For example, where softrobotics or other like technology is utilized to allow the EDA sensor orthe hybrid interface to be dynamically conformable to a desired shapeflexible materials may facilitate this conformability. Flexiblematerials may include, for example, Mylar or the like, textiles,leathers or polymers. Examples of polymers may include polyethylenenaphthalate (PEN), polyethylene terephthalateble (PET), polyimide (PI)and others. Embodiments may also use stretchable elastomers such as, forexample, polydimethylsiloxane (PDMS). As noted above, the electrodes canbe arranged in a desired pattern into disposed on the substrate in amanner such that they can come into contact with the user's skin.

The electrode layer is not limited in quantity of electrodes,arrangement electrodes, shape of the layer or other properties by theexample illustrated in FIG. 2 . Either or both the electrode layer andthe actuation layer can be provided in the appropriate shape and size toaccommodate the given application. The number and arrangement ofelectrodes in the EDA sensing layer can be likewise suited to theparticular application. The number and shape of the electrodes can varydepending on the size of the surface and its location in the vehicle orother application.

Embodiments may be configured to utilize transparent conductivematerials for the EDA sensing layer so that the structure implementedcan be invisible to the naked eye. This can allow configurations inwhich the structure can be embedded in common cockpit surfaces such asleathers and vinyls. Transparent conductors may include, for example,transparent conductive oxides (e.g., indium tin oxide), glassy polymersor other transparent conductive materials.

Similar to the EDA layer, actuation layer 140 can be manufactured usingflexible substrates to allow the actuation layer to be dynamicallyconformable. Also similar to the EDA layer, actuation layer 140 can bemanufactured using transparent conductive materials to provide aninvisible structure, which may be beneficial in aiding in the aestheticsof the installation.

A sensing module can be included to determine EDA based on currentmeasurements and to determine touch inputs by the actuation layer. Anexample processing circuit utilized to implement a sensing module isillustrated and described below with reference to FIG. 10 . Such asensing module can include a processor or other circuitry used todetermine current levels (e.g., based on a voltage level) at eachelectrode. The sensing module may also be configured to evaluate whichelectrodes have a better connection to the user's skin at a given timeand use measurements from those one or more electrodes to measure EDA.

Embodiments may be implemented in which information from electrodesidentified as providing a valid signal is used to measure EDA, andinformation from other electrodes is ignored or discarded. Embodimentsmay further be implemented in which information from the identifiedvalid electrodes is combined to arrive at a EDA measurement. Forexample, the information from the valid electrodes can be combined as anaverage of EDA measurements from the electrodes, a weighted average(e.g., for example, based on determined quality of information from theelectrodes) or other combination of information from the determinedvalid electrodes.

This can be accomplished, for example, based on pressure sensing at theEDA sensing layer or at the actuation layer. For example, pressuresensors may be included with the EDA sensing layer or the hybridinterface to measure pressure had some or all of the electrodes.

Evaluating which electrodes have a better connection to the user's skinat a given time might also be accomplished, for example, based oncontinuity of a signal from the EDA sensing layer or actuation layer.For instance, a signal that exhibits rapid variations may indicate theuser is only making intermittent contact at that electrode.

Flexible substrates and flexible conductive materials (e.g., silverpaste, copper paste, conductive films) can be used to allow the entirestructure to operate as a flexible and conformable device. This can beutilized to allow the structure to be dynamically conformed using, forexample, soft robotics. This can also allow the device to be implementedto conform to multiple different locations inside of the vehicle.

FIG. 5 illustrates an example embodiment in which EDA sensing surfacesare located on a vehicle steering wheel. In this example, EDA sensingsurfaces 306 are located at the 10 o'clock and 2 o'clock and positionsof the vehicle steering wheel. The EDA sensing surfaces can beconfigured as a flexible sensing surface to conform to the shape of thesteering wheel. In some embodiments, the EDA sensing surfaces 306 can beconfigured as an aftermarket installation they can be wrapped around thesteering wheel. In other applications, the EDA sensing surfaces 306 canbe provided as factory equipment integrated into the steering wheelcover. As noted above, transparent conductors can be used to provide adevice that is difficult to detect with the naked eye, thereby notinterfering with the aesthetic nature of the vehicle. Although EDAsensing surfaces 306 are shown as two patches at the 10 o'clock and 2o'clock positions of the steering wheel, they can be provided at otherlocations in addition to or instead of the 10 o'clock and 2 o'clockpositions, but may be preferably positioned at locations commonlygripped by vehicle operators to improve the likelihood that measurementscan be made. Also, the EDA sensing surfaces 306 can be smaller or largerthan those shown in the example of FIG. 5 , and can also be of adifferent shape.

FIG. 6 illustrates an example embodiment in which EDA sensing surfacesare located at multiple locations inside a vehicle cockpit. In thisexample, EDA sensing surfaces 308 are located on the door handle 309 andadjacent to window switch 307. This illustrates examples that might becommon or frequent touch points of a vehicle operator or passenger. Aswith EDA sensing surfaces 306, EDA sensing surfaces 308 may beconfigured in different shapes or sizes depending on where they areapplied. They can also be fabricated using transparent materials to aidin their aesthetics.

FIG. 7 illustrates an example embodiment in which an EDA sensing surfaceis located on the vehicle center console adjacent a touchpad or scrollwheel. View 330 illustrates a cockpit view of an EDA sensing surface 323adjacent to a user interface 324 and also illustrates a head unitdisplay 325. View 320 illustrates a top-down view of the vehicle centerconsole with EDA sensing surface 323 adjacent user interface 324. Inthis example, EDA sensing surface 323 is located on the vehicle centerconsole in approximately location where the vehicle operator's orpassenger's palm may rest when operating user input 324. Accordingly,user EDA measurements may be made when the user is resting there palm onthe arm rest at the location of EDA sensing surface 323.

An EDA sensing surface may also be positioned on the surface of touchpador input wheel of user input 324 to sense a user's EDA when the user istouching the surface of user input 324. In EDA sensing surface mayfurther be positioned on touchscreen interface 325. In these examples, ahybrid sensing surface may be used to provide a combination of EDAsensing and touch inputs sensing and user input 324 and touchscreeninterface 325. This can allow either or both of these devices to beoperated in a manner to gather EDA information while also sensing userinput.

As noted above, embodiments may be implemented in conjunction with softrobotics or other shape changing services to allow the EDA device(whether or not implemented as a hybrid device with a user actuationlayer) to be implemented in a manner such that the surface can undergoadjustments. Such adjustments might be made to conform to the shape ofthe user's hand, to provide a haptic response, or to otherwise changethe shape or surface texture. The ability to conform to the shape ofuser's hand can increase the comfort for the user and make it easier andmore likely that the user will rest their hands on the surface. This mayin turn enable longer and more stable EDA readings.

Accordingly, embodiments of the present disclosure may provide a liquidcrystal elastomer-based foundational device configured to provide thenoted conformance to the user's hand or a haptic feel that may enablefeedback regarding an actuator selection process or feedback to helpidentify a portion of the surface this should be pressed to provide adesired user input.

A formable surface may include an elastomer actuation region that may bemade up of a plurality of liquid crystal elastomer (LCE) structures.Different types of LCE structures may be combined in various embodimentsto provide different types of haptic feedback or desired surfacedeformations. Control systems may be implemented to control the locationand level of stimuli applied to one or more LCE structures, to createvarious shapes dynamically in the deformable surface. In alternativeembodiments, shape-memory alloys, E-rubbers and other shape changingmaterials may be used as well. These materials can be configured tochange shape and volume when stimulated with the appropriate input suchas light, electrical signals, or temperature. As noted, this can allowan EDA device, user input device, or hybrid EDA/input device to bedynamically formable such as to be conformable to the user's hand or toprovide desired haptic feedback.

Haptic feedback may include more than just feedback regarding actuation(e.g. confirmatory vibration, etc.) but may also or alternativelyinclude conforming the shape of the surface so that the user candifferentiate different inputs based on their unique, reformed shapes.For example, a normally flat surface can be adjusted dynamically toprovide a plurality of raised regions on the surface indicatingactuation points (e.g., buttons) that can be pressed to provide userinput. Embodiments may be implemented to create different buttonpatterns for different circumstances. For example, button patterns canbe created differently based on, for example, the vehicle system thatthe interface is currently controlling. Accordingly, there might be adifferent arrangement of buttons to control a climate control systemthan the arrangement to control an audio system. As another example,different button patterns can be generated based on user preferences.User profiles can be obtained and stored and user-specific buttonconfigurations generated dynamically for the identified then-currentuser.

As another example, button patterns may be dynamically created based onthen-current circumstances. For example, the vehicle may detect apotentially dangerous situation and offer the operator the option ofenabling a safety system (e.g., an ADAS system) in response to thedangerous situation. In this case, the vehicle can ask the operator(e.g., via synthesized voice) if he or she wants to enable the systemand may instruct the operator to press the raised button of the touchpadin response.

FIG. 8 illustrates an example of a structure for dynamicallyconfigurable EDA surface in accordance with various embodiments. In thisexample, an EDA layer 412 (e.g., EDA sensing surface 130) comprising amatrix of EDA electrodes can be positioned on a soft robotics-basedmatrix 414. Although not illustrated, an actuation layer (e.g.,actuation layer 140) may also be included. These two layers can beaffixed to soft robotics matrix 414, such that they conform to thesurface of soft robotics matrix 414 when soft robotics matrix 414 isreconfigured.

The touch sensing matrix on the actuation layer can be configured todetect the shape of the user's hand and this information can be used toactuate the tactile pixels in soft robotics-based matrix 414accordingly. By doing so, the structure, including EDA layer 412 canaccommodate the users hands more comfortably. Accordingly, EDA layer 412and any included actuation layer can be composed of flexible, formablematerials so that they can adequately adapt to the desired shape. In theexample of FIG. 8, 410 illustrates soft robotics-based matrix 414 in anon-deformed configuration with a flat top surface. At 411, FIG. 8illustrates soft robotics-based matrix 414 deformed by reducing theheight of the interior rows of the matrix. FIG. 9 illustrates an examplein which soft robotics-based matrix 414 is re-shaped to conform to theuser's hand 420, and further illustrates that the EDA layer 412 (and theactuation layer, if included) conform to the reshaped softrobotics-based matrix 414.

While the examples of FIGS. 8 and 9 illustrate shape formation on acolumn-by-column basis, shape formation can also be controlledrow-by-row or at a pixel level to create a variety of different shapes.The pixel size and quantity of pixels (i.e., resolution) can be adjustedbased on the application to provide desired control over possible shapesand sizes of the shapes that can be created.

As illustrated above with reference to FIG. 7 , one of the possibleapplications of embodiments disclosed herein is in a hand rest near aconsole-located user interface. However, given the flexible andcompliant nature of various embodiments, the device can be easilyincorporated into other regions of the vehicle or it can be used inapplications other than in vehicles. For example, if a conformablestructure is placed in the steering wheel, the tactile pixels couldactuate to generate a grasp that feels more comfortable to each driver.Additionally, the touch sensing manage that forms the actuation layercould be used to allow the driver to execute commands without takinghands off the steering wheel. Actuation might be sensed, for example, bythe user simply tightening the grip of one or more fingers on thesteering wheel. As another example, the system can be configured toallow the user to use taps or swipe gestures to control various vehiclesystems.

The EDA detection can be used to control a variety of vehicle systemsuch as, for example, driver alerts (e.g., “you are getting sleepy andshould consider taking a rest” or “you appear to be distracted andshould focus on driving”), safety systems or other vehicle systems. TheEDA detection system may also be used to provide a more sophisticatedinterface between the user's emotional state and the vehicles userinterface. If for example, the system detects that the driver isdistracted, the vehicle cockpit can be reconfigured to hide certainbutton options, thereby reducing or minimizing the opportunities tocreate further distraction. Likewise, if the driver is not distractedand road conditions are known to be safe, the system can enable morebuttons allowing safe usage of peripheral functions.

The systems and methods disclosed herein are described in variousexamples as being implemented with passenger, cargo or other vehicles.However, the systems and methods disclosed herein are not limited toapplications in vehicles and may be implemented in a number of othersettings where it may be useful or desirable to monitor EDA.

As used herein, the term module may be used describe a given unit offunctionality that can be performed in accordance with one or moreembodiments of the present application. As used herein, a module mightbe implemented utilizing any form of hardware, software, or acombination thereof. For example, one or more processors, controllers,ASICs, PLAs, PALs, CPLDs, FPGAs, logical components, software routinesor other mechanisms might be implemented to make up a module. Variouscomponents described herein may be implemented as discrete module ordescribed functions and features can be shared in part or in total amongone or more modules. In other words, as would be apparent to one ofordinary skill in the art after reading this description, the variousfeatures and functionality described herein may be implemented in anygiven application. They can be implemented in one or more separate orshared modules in various combinations and permutations. Althoughvarious features or functional elements may be individually described orclaimed as separate components, it should be understood that thesefeatures/functionality can be shared among one or more common softwareand hardware elements. Such a description shall not require or implythat separate hardware or software components are used to implement suchfeatures or functionality.

Where modules are implemented in whole or in part using software, thesesoftware elements can be implemented to operate with a computing orprocessing component capable of carrying out the functionality describedwith respect thereto. One such example computing component is shown inFIG. 10 . Various embodiments are described in terms of thisexample-computing component 500. After reading this description, it willbecome apparent to a person skilled in the relevant art how to implementthe application using other computing components or architectures.

Referring now to FIG. 10 , computing component 500 may represent, forexample, computing or processing capabilities found within aself-adjusting display, desktop, laptop, notebook, and tablet computers.They may be found in hand-held computing devices (tablets, PDA's, smartphones, cell phones, palmtops, etc.). They may be found in workstationsor other devices with displays, servers, or any other type ofspecial-purpose or general-purpose computing devices as may be desirableor appropriate for a given application or environment. Computingcomponent 500 might also represent computing capabilities embeddedwithin or otherwise available to a given device. For example, acomputing component might be found in other electronic devices such as,for example, portable computing devices, and other electronic devicesthat might include some form of processing capability.

Computing component 500 might include, for example, one or moreprocessors, controllers, control components, or other processingdevices. Processor 504 might be implemented using a general-purpose orspecial-purpose processing engine such as, for example, amicroprocessor, controller, or other control logic. Processor 504 may beconnected to a bus 502. However, any communication medium can be used tofacilitate interaction with other components of computing component 500or to communicate externally.

Computing component 500 might also include one or more memorycomponents, simply referred to herein as main memory 508. For example,random access memory (RAM) or other dynamic memory, might be used forstoring information and instructions to be executed by processor 504.Main memory 508 might also be used for storing temporary variables orother intermediate information during execution of instructions to beexecuted by processor 504. Computing component 500 might likewiseinclude a read only memory (“ROM”) or other static storage devicecoupled to bus 502 for storing static information and instructions forprocessor 504.

The computing component 500 might also include one or more various formsof information storage mechanism 510, which might include, for example,a media drive 512 and a storage unit interface 520. The media drive 512might include a drive or other mechanism to support fixed or removablestorage media 514. For example, a hard disk drive, a solid-state drive,a magnetic tape drive, an optical drive, a compact disc (CD) or digitalvideo disc (DVD) drive (R or RW), or other removable or fixed mediadrive might be provided. Storage media 514 might include, for example, ahard disk, an integrated circuit assembly, magnetic tape, cartridge,optical disk, a CD or DVD. Storage media 514 may be any other fixed orremovable medium that is read by, written to or accessed by media drive512. As these examples illustrate, the storage media 514 can include acomputer usable storage medium having stored therein computer softwareor data.

In alternative embodiments, information storage mechanism 510 mightinclude other similar instrumentalities for allowing computer programsor other instructions or data to be loaded into computing component 500.Such instrumentalities might include, for example, a fixed or removablestorage unit 522 and an interface 520. Examples of such storage units522 and interfaces 520 can include a program cartridge and cartridgeinterface, a removable memory (for example, a flash memory or otherremovable memory component) and memory slot. Other examples may includea PCMCIA slot and card, and other fixed or removable storage units 522and interfaces 520 that allow software and data to be transferred fromstorage unit 522 to computing component 500.

Computing component 500 might also include a communications interface524. Communications interface 524 might be used to allow software anddata to be transferred between computing component 500 and externaldevices. Examples of communications interface 524 might include a modemor softmodem, a network interface (such as Ethernet, network interfacecard, IEEE 802.XX or other interface). Other examples include acommunications port (such as for example, a USB port, IR port, RS232port Bluetooth® interface, or other port), or other communicationsinterface. Software/data transferred via communications interface 524may be carried on signals, which can be electronic, electromagnetic(which includes optical) or other signals capable of being exchanged bya given communications interface 524. These signals might be provided tocommunications interface 524 via a channel 528. Channel 528 might carrysignals and might be implemented using a wired or wireless communicationmedium. Some examples of a channel might include a phone line, acellular link, an RF link, an optical link, a network interface, a localor wide area network, and other wired or wireless communicationschannels.

In this document, the terms “computer program medium” and “computerusable medium” are used to generally refer to transitory ornon-transitory media. Such media may be, e.g., memory 508, storage unit520, media 514, and channel 528. These and other various forms ofcomputer program media or computer usable media may be involved incarrying one or more sequences of one or more instructions to aprocessing device for execution. Such instructions embodied on themedium, are generally referred to as “computer program code” or a“computer program product” (which may be grouped in the form of computerprograms or other groupings). When executed, such instructions mightenable the computing component 500 to perform features or functions ofthe present application as discussed herein.

It should be understood that the various features, aspects andfunctionality described in one or more of the individual embodiments arenot limited in their applicability to the particular embodiment withwhich they are described. Instead, they can be applied, alone or invarious combinations, to one or more other embodiments, whether or notsuch embodiments are described and whether or not such features arepresented as being a part of a described embodiment. Thus, the breadthand scope of the present application should not be limited by any of theabove-described exemplary embodiments.

Terms and phrases used in this document, and variations thereof, unlessotherwise expressly stated, should be construed as open ended as opposedto limiting. As examples of the foregoing, the term “including” shouldbe read as meaning “including, without limitation” or the like. The term“example” is used to provide exemplary instances of the item indiscussion, not an exhaustive or limiting list thereof. The terms “a” or“an” should be read as meaning “at least one,” “one or more” or thelike; and adjectives such as “conventional,” “traditional,” “normal,”“standard,” “known.” Terms of similar meaning should not be construed aslimiting the item described to a given time period or to an itemavailable as of a given time. Instead, they should be read to encompassconventional, traditional, normal, or standard technologies that may beavailable or known now or at any time in the future. Where this documentrefers to technologies that would be apparent or known to one ofordinary skill in the art, such technologies encompass those apparent orknown to the skilled artisan now or at any time in the future.

The presence of broadening words and phrases such as “one or more,” “atleast,” “but not limited to” or other like phrases in some instancesshall not be read to mean that the narrower case is intended or requiredin instances where such broadening phrases may be absent. The use of theterm “component” does not imply that the aspects or functionalitydescribed or claimed as part of the component are all configured in acommon package. Indeed, any or all of the various aspects of acomponent, whether control logic or other components, can be combined ina single package or separately maintained and can further be distributedin multiple groupings or packages or across multiple locations.

Additionally, the various embodiments set forth herein are described interms of exemplary block diagrams, flow charts and other illustrations.As will become apparent to one of ordinary skill in the art afterreading this document, the illustrated embodiments and their variousalternatives can be implemented without confinement to the illustratedexamples. For example, block diagrams and their accompanying descriptionshould not be construed as mandating a particular architecture orconfiguration.

What is claimed is:
 1. A dynamically formable electrodermal activity(EDA) sensor, comprising: a dynamically formable base comprising aformable surface configured to be dynamically formed in response toinput signals; an EDA sensing layer affixed to the formable surface ofthe dynamically formable base, the EDA sensing layer comprising aplurality of sensors connected to a power supply; and a processorconfigured to determine an EDA of a user based on EDA measurements fromthe EDA sensing layer, wherein the input signals are based on thedetermined EDA of the user, wherein, in response to the input signals,the formable surface of the dynamically formable base and the EDAsensing layer affixed thereto are reformed into a desired contour. 2.The dynamically formable EDA sensor of claim 1, wherein the processor isfurther configured to provide the input signals to the dynamicallyformable base in response to pressure measurements to adjust theformable surface of the dynamically formable base to conform to a bodypart of the user.
 3. The dynamically formable EDA sensor of claim 1,wherein the dynamically formable base comprises a plurality ofseparately actuatable elements arranged in a matrix, such thatcontrolling the input signals to each of the separately actuatableelements determines a result in contour of the formable surface.
 4. Thedynamically formable EDA sensor of claim 1, wherein the dynamicallyformable base comprises a soft robotics material.
 5. The dynamicallyformable EDA sensor of claim 1, wherein the EDA sensing layer comprisesa plurality of electrodes on a flexible substrate, and wherein theprocessor is configured to evaluate a connection strength betweenelectrodes of the EDA sensing layer and skin of the user at a given timeand to identify electrodes from which EDA measurements are to be madebased on the evaluation.
 6. The dynamically formable EDA sensor of claim5, wherein the processor is further configured to determine the EDA ofthe user based on EDA measurements from the identified electrodes. 7.The dynamically formable EDA sensor of claim 5, wherein the EDA of theuser is determined based on a combination of measurements from theidentified electrodes.
 8. The dynamically formable EDA sensor of claim1, wherein the dynamically formable base is configured to be reformed toconform to at least a portion of a user's hand.
 9. The dynamicallyformable EDA sensor of claim 1, wherein the dynamically formable base isconfigured to be reformed to provide a haptic response to a user of thedynamically formable EDA sensor.
 10. The dynamically formable EDA sensorof claim 1, wherein the dynamically formable base is configured to bereformed to provide one or more raised regions on the formable surfacebased on the input signal, each of the one or more raised regionsindicating a button configured to receive a user input.
 11. A hybridelectrodermal activity (EDA) sensor and user input device, comprising: aflexible EDA layer comprising a first flexible substrate and a pluralityof electrodes disposed on the first flexible substrate; a flexibleactuation layer affixed to the flexible EDA layer, the flexibleactuation layer comprising electrical contacts disposed on a secondflexible substrate; and a processor configured to determine an EDA of auser based on EDA measurements from one or more electrodes of theplurality of electrodes and provide an input signal to a formablesurface based, in part, on the determined EDA of the user, wherein theformable surface is formed into a desired contour in response to theinput signal.
 12. The hybrid EDA sensor and user input device of claim11, wherein the first and second flexible substrates comprisetransparent substrates, and wherein the electrodes disposed on the firstflexible substrate and the electrical contacts disposed on the secondflexible substrate comprise transparent conductive materials.
 13. Thehybrid EDA sensor and user input device of claim 11, wherein theprocessor is further configured to provide the input signal to theflexible actuation layer based on an amount of pressure applied by theuser to the flexible EDA layer.
 14. The hybrid EDA sensor and user inputdevice of claim 11, wherein the processor is further configured toevaluate a connection strength between electrodes of the flexible EDAlayer and a user's skin at a given time and to identify electrodes fromwhich the EDA measurements are to be made based on the evaluation. 15.The hybrid EDA sensor and user input device of claim 14, wherein theprocessor is further configured to determine the EDA of the user basedon the EDA measurements from the identified electrodes.
 16. The hybridEDA sensor and user input device of claim 14, wherein the EDA of theuser is determined based on a combination of measurements from theidentified electrodes.
 17. A system for processing information from aplurality of electrodermal activity (EDA) sensors to determine an EDA ofa user, comprising: a processor; and a non-transitory memory coupled tothe processor and configured to store instructions, the instructions,which when executed cause the processor to perform operationscomprising: receiving information from a plurality of electrodes of anEDA sensor; determining an EDA measurement for the user based on theinformation received from the plurality of electrodes; and providing aninput signal to a formable surface based, in part, on the determined EDAmeasurement for the user, wherein the formable surface is formed into adesired contour in response to the input signal.
 18. The system of claim17, wherein determining an EDA measurement comprises computing aweighted average of EDA measurements from the electrodes.
 19. A methodof processing information from a plurality of electrodermal activity(EDA) sensors to determine an EDA of a user, comprising: receivinginformation from a plurality of electrodes of an EDA sensor; determiningan EDA measurement for the user based on the information received fromthe plurality of electrodes; and providing an input signal to a formablesurface based, in part, on the determined EDA measurement for the user,wherein the formable surface is formed into a desired contour inresponse to the input signal.
 20. The method of claim 19, whereindetermining an EDA measurement comprises computing a weighted average ofEDA measurements from the electrodes.